DOCUMENT RESUME 



ED 324 319 



TM 012 991 



AUTHOR 
TITLE 

INSTITUTION 

SPONS AGENCY 

PUB DATE 
CONTRACT 
NOTE 



PUB TYPE 



Hannaman, Paula M. 

ERIC/TM Acquisition ^recess: Its Benefits to the 
Educational Community & You. 
ERIC Clearinghouse on Tests, Measurement, and 
Evaluation, Washington, DC. 

Office of Educational Research and Improvement (ED), 
Washington, DC. 
30 Mar 89 
RI88062003 

2Ip.? Paper presented at the Annual Meeting of the 
Nacional Council on Measurement in Education (San 
Francisco, CA, March 28-30, 1989). For related 
documents, see ED 307 320 by L. M. Rudner and L. L. 
Wise (1989) and ED 307 335 by T. E. Eissenberg 
(1989) . 

Speeches/Conference Papers (150) 



EDRS PRICE MFOl/PCOl Plus Postage. 

DESCRIPTORS *Clearinghouses ; Databases; Data Collection; 

*Jocumentation; *Educational Research; Educational 
Resources; Information Dissemination; Information 
Sources? Information Storage; * Information Systems; 
Research Reports 

IDENTIFIERS Document Analysis; *ERIC Clearinghouse on Tests 
Measurement Evaluation; National Council on 
Measurement, in Education 



ABSTRACT 

The process by which the Educational Resources 
Information Center's Clearing^i>use on Tests, Measurement, and 
Evaluation (ERIC/TM) acquires documents and the ways in which it 
offers them to users are discussed. Focus is on identifying how the 
ERIC/TM and members of the National Council on Measurement in 
Education (NOME) can cooperate to increase the standards aiid quality 
of professional knowledge in tl^e educational community. 
Responsibilities of the ERIC/TM are to: (1) identify, acquire, and 
select literature within the clearinghouse scope; (2)* process 
selected documents to maintain tne ERIC database; and (3) disseminate 
information to policymakers, program planners, practitioners, and 
researchers via the database, publications, and user-information 
staff. Although the working relatic-nsnip between the ERIC/TM and NOME 
has been mutually supportive, both could benefit by a greater 
incorporation of documents from NCMS members into the ERIC/TM 
database. ERIC/TM document processing is described. Benefits to 
authors of submitting their documents to the ERIC/TM include: (1) 
wider dissemination of knowledge; (2) free publicity; (3) quick and 
easy retrieval by a worldwide audience; (4) selected documents will 
never go "out of print"; (5) provision of a complementary microfiche 
of the document; and (6) ERIC acceptance does not preclude other 
publication. Seven figures illustrate tne text. (SLD) 
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Overview 



The objective of this paper is to identify how the National Council on Measurement in 
Education (NCME) members and the ERIC Qearinghouse on Tests, Measurement, and 
Evaluation (ERIC/TM) can cooperat*; with each other while simultaneously increasing the 
standards and quality of the educational community's knowledge base. To achieve this 
objective, the following topics will be discussed: 

• ERIC and ERIC/TM 

• Supporting ERIC/TM Users 

• ERIC/TM and Professional Associations - Relational Benefits 

• Importance of the NCME and ERIC/TM Relationship 

• Processing ERIC/TM Papers 



ERIC and ERIC/TM 



The Educational Resources Information Center (ERIC) is a worldwide information network 
that collects English-language documents and journals from and disseminates them to the 
educational community. As illustrated in Figure 1 (on page 2), ERIC is sponsored by the 
Office of Educational Research and Improvement (OERI) thro . ^h the U.S. Department of 
Education. The staff of OERI monitor the ERIC system and establishes system-wide 
policies. 

The ERIC Processing and Reference Facility coordinates the activities of the 16 
clearinghouses It provides central editing, and database building support for all ERIC 
'documents. Additionally, the facility also coordinates: 

• acquisition activities 

• editorial activities 

• document control 

• lexicography 

• data entry 

• reference services 
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Figure 1. ERIC and ERIC/TM 
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ERIC/TM 



A more complete discussion of the facility's functions and responsibilities can be found in 
Rudner & Wise (1989). 

The ERIC Qearinghouse on Tests, Measurement, and Evaluation (ERIC/TM) is one of 16 
subject-specialized clearinghouses. ERIC/TM's responsibilities, as illustrated in Figure 2 
(on page 3) include: 

Acquisition of Documents 

• identify, acquire, and select significant and timely literature within our scope of 
interest 

• stay aware of the current trends 
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Figure! ERIC/TM RespoosibUities 
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Maintain Database 



♦ process selected documents for entry into the ERIC system by cataloging, 
indexing, and abstracting each document 



Disseminate Infomiation 

^ establish and use effective dissemination strategies 

♦ prepare summary materials and state-of-the-art papers for policymakers, 
program planners, practitioners, and researchers 

♦ furnish users with services and products 



Supporting ERIC/TM Users 

ERICyTM users encompass both organizations and individuals. Organizations include 
professional associations, such as the National Council on Measurement in Education 
(NCME), academia, and federal, state, local government agencies. Individuals include 
policy-makers, program planners, practitioners and researchers. 



The needs of these users vary greatly. ERICyXM is sensitive to the varying needs of its 
users. Specifically, ERIC/TM employs a full array of information dissemination techni- 
ques, ranging from state-of-the-art electronic technologies, such as CD-ROM compact 
disks, to traditional print-based media. 

The key to satisfying ERIC/TM user needs is its database. The ERIC database consists 
of two parts: Resources in Education (RIE) and Current Index to Journals in Education 
(CIJE). ERIC/TM users can access the database in a variety of ways as shown in Figure 
3 (on page 5). 

More than 2,000 organizations provide personal computer access to the database in one of 
two ways: 



• through online information retrieval services, such as Dialog, BRS, and SDC 

• through libraries and other organizations, users can obtain compact disks (CD- 
ROM) systems, such as the Online Computer Library Center (OCLC), Dialog On 
Disk, and SilverPlatter v / 5 
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Figure! Supporting ERICTTM Users 
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Ref ererxxs on Disk 






ERICyTM h^iS developed a new publication series for users called. References on Disk 
(ROD). The first product of this series is FINDIT, an cumulative indices of several 
journals on floppy disk. These indices are based on the abstracts prepared and found in 
CUE. At this time, FINDIT includes the following journals: 

• Journal of Educational Measurement 

• Educational Measurement 

• Journal of Educational Statistics 

• Psychometrika 

• American Educational Research Journal 

• Review of Educational Research 

Each FINDIT floppy disk includes full journal citations, and ERIC descriptors. FINDIT 
allows the user to search its database by author or keyword. FINDIT is available to 
users with a custom-developed search software for $15.00 from ERIC/TM. 

RIE contains the abstracts of more than 200,000 research reports, speeches, curriculum 
guides, tests, teaching manuals, and other educational documents. The full text of most 
documents announced through RIE are archived on microfiche and made available in over 
800 locations, including the ERIC Document Reproduction Service (EDRS) and most 
academic libraries. 

In addition to RIE, ajE> and References on Disk, ERIC/TM prepares three publication 
series of complied information on tests, measurement, and evaluation issues. 

Monographs* Interpretive summaries, research reviews, bibliographies, and digests 
about critical topics. 

Highlights. Abstracts and citations for at 30 key articles on a given topic. 

Digests. Two page information sheets on current topics and issues. 

ERIC/TM maintains a full-time staff to assist users in obtaining information. They can 
be reached during normal working hours at (202) 342-5060. This "human" interface with 
ERIC/TM has proven to be a vital link between the clearinghouse and the users. 
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ERIC/TM and Professional Associations - Relational Benefits 



ERICVTM collects papers from and disseminates information to 21 different professional 
association. They are: 

American Council on Education (ACE) 

American Educational Research Association (AERA) 

American Evaluation Association (AEA) 

American Society for Training and Development (ASTD) 

American Statistical Association (ASA) 

California Educational Research Association (CERA) 

College Board National Forum 

Eastern Educational Research Association QBERA) 

Eastern Evaluation Research Society (EERS) 

Education Commission of the States - Annual Assessment Conference (ECS-AAC) 

International Association for Educational Assessment (IAEA) 

International Personnel Management Association (IPMA) 

International Society for Intercultural Education Training and Research 

Michigan Educational Research Association (MERA) 

Michigan School Testing (MST) 

Mid-South Educational Research Association (MSERA) 

National Association of Test Directors (NATD) 

National Council on Measurement in Education (NCME) 

National Testing Network in Writing, Conference on Writing Assessment (NTNW) 

Psychometric Society 

Psychonomic Society 



Having read the list, one might conclude that the interests of these associations may 
vary. For example, the American Statistical Association (ASA) interests vould differ 
from those of International Personnel Management Association (IPMA). Although this 
may be true, they also share many common interests that are ihe hallmarks of ERIC/TM: 



• tests and other measurement devices 

• methodology of measurement and evaluation 

• application of tests, measurement, and evaluation in educational projects or 



programs 



research design and methodology in the area of testing, measurement, and 
evaluation 



learning theory in general 



Combined, these interests serve to enhance the quality and standards of knowledge base 
of these association members. 
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The relationship between National Council on Measurement in Education (NCME) and 
ERIC/TM illustrates, as shown in Figure 4, how such a relationship can be mutually 
beneficial. 



Figure 4, Benefits of the Relationship between NCME and ERICyXM 
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The NCME management provides ERIQTM with mailing lists, membership directories, an 
advance copy of the annual meeting proceedings, and announcement space for their 
monthly journal. Educational Measurement: Issues & Practices. Individual NCME members 
also prepare and critique ERICyTM publications. This long-standing support from NCME 
has contributed greatly to achieving ERIQTM goals. 

ERIC/TM has provided full coverage of NCME publications and permanently archived 
papers and reports prepared by NCME members. We routiiiely assist ERIC/TM users 
locate NCME conference papers. Some of our new products are targeted primarily to 
NCME members, such as FINDIT. These ERIC/TM products have assisted NCME members 
in doing their work and conductii?.g research. 

The relationships between professional associations and ERIC/TM are truly symbiotic. 
The long-standing relationship between NCME and ERIC/TM exemplifies the benefits that 
can be achieved as a result of such a symbioses. 
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Importance of the NCME and ERIC/TM Relationship 

Since 1971, ERICTTM and the central office of the American Educational Research 
Association (AERA) have collaborated to incorporate all AERA conference papers into 
ERIC This 18-year relationship has paid off for both AERA and ERICAS. 

The working relationship between ERICVTM and NCME are supportive of each other's 
work. However, we at ERICTTM are disappointed in our ability to obtain papers and 
reports prepared by NCME members. 

The AERA membership is one of ERIQTM's major sources of documents as shown in 
Table L The AERA membership represents the diversity of the entire ERIC database. A 
few numbers dramatize this fact. We received 1,586 documents in 1988. As Table 1 
shows, 31% of the accepted documents in the ERICTTM database were from AERA 
members. 



Table 1. Distribution of ERICyTM's 1988 Documents 




Total in TM 


AERA 


NCME 


^4ISC. 


Accepted 


771 


245 or 31% 


50 or 99% 


476 or 64% 


Rejected 


220 


16 or 9% 


lor 1% 


7 or 19% 


Transferred 




42Qor60% 


_Qor 0% 


125 or 17% 


TOTAL 


1,586 


790 or 50% 


51 or 3% 


745 or 47% 



The comparatively low number of NCME documents in the ERIC/TM database is disturbing 
for several reasons. Most important of these is the fact that the scope of interest of 
ERIC/TM is more closely aligned with NCME's scope of interests than with any other 
professional association. The fact that the rejection and transfer rates for NCME 
documents is far less than that of any other sou. ce collaborates this belief. 

The strong common interest should result in a larger percentage of NCME documents in 
the ERIC/TM database. For example, more than 180 papers were presented at the 1988 
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NCME annual meeting. This is almost foiir times greater than the total number of papers 
ERICyrM received from the NCME membership in 1988. 

We have concluded these disparities are attributed to a lack of communication between 
ERIC/TM and the NCME membership. It is hoped this paper will enhance this com- 
munication. 



Processing ERIC/TM Papers 

if you have recently written a research report, a program description or evaluation, a 
review of literature, or a conference paper that is 5 or more pages and is related the to 
educational community, you should send it to ERICyTM. In turn, ERICTM can per- 
ma* ently archive your document and make it available to a worldwide network of 
EFICyTM users. Simply send two copies of the document on white paper and a com- 
pleted reproc^uction release form to ERIC/TM. 

ERICyTM has an automated system for processing documents and for notifying authors of 
the status of their documents. Soon after a document appears in our mailbox, the 
Processing Coordinator logs in the document by assigning the document a unique acces- 
sion number. This number is written on the document and every item pertaining it Into 
a specially designed database program, we enter: 

• title of the document 

• names(s) of author(s) 

• publication date 

• date document was entered into the system 

• number of pages 

• source of the document, (e.g., NCME or AERA conference) 

• level of reproduction release 

• number of copies of the document sent 

• author's address 

As shown in Figure 5 (on page 11), once this information is entered into the program, 
we print a tracking log sheet. This tracking log sheet includes the above information 
and allows us to enter other information throughout the processing of the document. 
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Figure 5. What ERIC/TM Does with Youi Document 



Log-In & Assign 
Tracking Number 
To 

Document 



Check 
for 
Duplication 


Duplicate Found 






None Found 



Check Scope 
& 

Review Content 



Transfer 



Reject 



, ^ccept 



Check 
Copyright 
& 

Legibility 



Problem 



No Problem 



Abstract 
Document & 
Create Resume 



Discard 



Notify 
Author 



Notify 
Author 



Problem 
can not be 
Resolved 



Notify Author 
HOLD 
Document 
until Solved 



Problem 
Resolved 



ERLC 



Re-'iume 
Checked 




Transmit 
Resume & 
Mail Document 
to Facility 


Accuracy 






11 , 

15 





The document, the release, the tracking log sheet, and any other correspondence is 
placed in a folder and given to the Review Coordinator The Review Coordinator reviews 
the document with the following selection criteria in mind: 

• relevance and timeliness 

• methodology 

• effectiveness of presentation 

The Review Coordinator either accepts or rejects the dociunent, based on our scope of 
interest. If it is outside of ERIC/TM's scope of interest, it is transferred to the 
appropriate clearinghouse. The Director of ERIC/TM reviews all documents again. For 
further explanation of ERIC/TM's review process, see Eissenberg (1989). 

All reviewed documents are returned to the Processing Coordinator. If it is accepted and 
already has a release, the author is toid of its acceptance and the accession number. If 
it's accepted but there's no release, the author is asked to complete a reproduction 
release form and retrm . The document is put in a "holding box" for 60 days to wait 
for the completed release. After 60 days, a second letter and release form are sent. If 
we arc unable to obtain a release the document is reviewed again for acceptance as a 
Level III (announcement availability) or rejection. Should the document be rejected, 
the author is notified of its rejection. Rejected documents are kept in a "rejection box" 
for 60 days, after which time the document is discarded- If the document is transferred 
to another clearinghouse, the author is told the name and phone number of the 
clearinghouse. 

Accepted documents are sent to our professional abstractors who read and abstract the 
document. As shown in Figure 6 (on page 14), a resume is created for the document 
that includes descriptors, identifiers, and an abstract. The document and resume are 
returned to the Review Coordinator, who verifies the resume's accuracy. The resume is 
electronically transmitted to the facility, while the document is simultaneously mailed to 
them. The facility verifies all of the information on the resume again and makes any 
appropriate changes to it. 
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Figure 6. Sample RDB Resume 
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Central Univ., Chicago, IL 
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Washington, DC. 
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Pub Date — May 83 
Contnwn— NIE-C-83-0001 
Note — 129p.; Paper presented at the National 
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Available from—Campus Bookstore, 123 College 
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order for women to take advantage of increased labor 
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better career planning and counseling. (2) change 
their career aspirations, and (3) fully utilize the 
sources of legal protection and assistance that are 
available to thenrt (SB) 
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An electronic copy or magnetic tape of the resume and the original document are sent to 
the ERIC Document Reproduction Service (EDRS). They archive the resume and every 
page of the original document on microfiche. EDRS distributes the microfiche to more 
than 800 ERIC subscribers and the 16 clearinghouses. Each clearinghouse receives a 
complimentary copy of the microfiche and resume to send to the author. 

Magnetic tapes of the resumes are sold to several online and CD-ROM information 
retrieval systems as mentioned earlier. 
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Conclusion 



The objective of this paper was to identify how NCME members and ERIC/TM could 
cooperate with each while simultaneously increasing the standards and quality of the 
educational community's knowledge base. 

We have discussed the benefits and importance of our relationship. We have identified 
the need for and importance of NCME's contributions to inaeasing the educational 
knowledge base in tests, measurement, and evaluation. This need can be met by 
submitting your documents to ERIQTM. In turn, you can benefit both personally and 
professionally as shown below in Figure 7. 



Figure?. Reaping the Benefits 
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No Cost 



SpeciHcally, you benefit because ERICyTM can assure you: 

• wider dissemination of your knowledge 

• free publicity 

• quick & easy retrieval of your document by a worldwide audience 

• your document will never go "out of print" 

• a complimentary microfiche of your document 

• ERIC acceptance of your document will not preclude you from having the 
document published elsewhere 

And, all of this at NO COST to you or your organization. 
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